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ON THE WIENER DISORDER PROBLEM 

By Semih Onur Sezer 

Sahanci University 

In the Wiener disorder problem, the drift of a Wiener process 
changes suddenly at some unknown and unobservable disorder time. 
The objective is to detect this change as quickly as possible after it 
happens. Earlier work on the Bayesian formulation of this problem 
brings optimal (or asymptotically optimal) detection rules assuming 
that the prior distribution of the change time is given at time zero, 
and additional information is received by observing the Wiener pro- 
cess only. Here, we consider a different information structure where 
possible causes of this disorder are observed. More precisely, we as- 
sume that we also observe an arrival/counting process representing 
external shocks. The disorder happens because of these shocks, and 
the change time coincides with one of the arrival times. Such a formu- 
lation arises, for example, from detecting a change in financial data 
caused by major financial events, or detecting damages in structures 
caused by earthquakes. In this paper, we formulate the problem in 
a Bayesian framework assuming that those observable shocks form 
a Poisson process. We present an optimal detection rule that mini- 
mizes a linear Bayes risk, which includes the expected detection delay 
and the probability of early false alarms. We also give the solution 
of the "variational formulation" where the objective is to minimize 
the detection delay over all stopping rules for which the false alarm 
probability does not exceed a given constant. 

1. Introduction. Suppose that at time t = we start observing a Wiener 
process X and a simple Poisson process N with arrival times {Tn)n>o- The 
Poisson process is assumed to apply external shocks on X, and these shocks 
will eventually cause a change in the drift of X. The time O, at which the 
drift changes is unknown and unobservable. We only know that it coincides 
with one of the arrival times according to the prior distribution 

(1.1) P{G = 0} = ^, P{G = T„} = (l-^)(l-p)"-^p foralln>l 
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for some known vr € [0, 1) and p € (0, 1]. We also assume that pre- and post- 
disorder drifts /io and are given, and the arrival rate A of the Poisson 
process is known. 

Our aim is to detect the time as quickly as possible after it happens, and 
by using our observations from the processes X and N only. More precisely, 
if we let F = {Tt}t>o be the observation filtration, our objective is to find 
an F-stopping time r that minimizes the Bayes risk 



for some delay cost c > 0. If such a stopping time exists, then it resolves 
optimally the trade-off between early false alarms and detection delay. 

We also consider an alternative but related formulation, in which the 
objective is to minimize the detection delay E(r — Q)^ over all F-stopping 
times, for which the false alarm frequency P{t < 0} is bounded above by a 
given constant a G (0, 1). Needless to say, this formulation is more desirable 
if frequent false alarms cannot be tolerated. 

Change detection problems have been studied in the literature with nu- 
merous applications in different contexts. These applications include quality 
control and fault detection in industrial processes, detection of onset of an 
epidemic in biomedical signal processing, target identification in national de- 
fense, intrusion detection in computer networks and security systems, threat 
detection in national security, pattern recognition in seismology, detection 
of change in the riskiness of financial assets, and many others. The reader 
may refer to [1, 3, 11-13, 23-27], and the references therein for an extensive 
discussion on these and other applications. 

Earlier foundational studies on change detection problems include [14] 
and [16] on non-Bayesian settings; and [9] and [22] on Bayesian formulations 
respectively. In particular, [22] gives the solution of the Bayesian formulation 
of the Wiener disorder problem for the Bayes risk in (1.2) assuming that the 
change time has an exponential prior distribution (see also [20, 21]). Later, 
following [19], this problem is reconsidered by [6] for a different Bayes risk 
including an exponential penalty term (which is more suitable for financial 
applications). Recently, [8] obtained the solution of the finite- horizon version 
of the original formulation of [22] (see also [17], Chapter 6.22). The extension 
to the case where observations consist of multiple Wiener processes is given 



The common assumption in this line of work is that the change-time has 
(zero-modified) exponential distribution. Under this assumption, the suffi- 
cient statistic (i.e., conditional probability process) is one dimensional, and it 
is possible to obtain explicit results. In addition to this analytical advantage, 
the exponential distribution can be regarded as a reasonable choice for highly 



(1.2) 




by [7]. 



ON THE WIENER DISORDER PROBLEM 



3 



reliable systems considering the asymptotic approximation of the exponen- 
tial distribution with geometric distribution. That is, if we perform indepen- 
dent experiments at times 6, 26, 35, . . . , for 5 > 0, where the failure (disorder) 
probability is Xd, then as 5 — t- O"*" we have P(time to first failure > i) — >■ e~^^. 

In other settings where the prior distribution is not exponential, the liter- 
ature offers asymptotically optimal Bayes rules. When the prior distribution 
is not exponential, sufficient statistics are not one-dimensional anymore, and 
explicit results are difficult to obtain, in which case asymptotically optimal 
rules prove useful for online implementation. The reader may refer to, for 
example, [4] and [5] for such asymptotical results including explicit expan- 
sions of the optimal Bayes risks [which are modified versions of (1.2)]; see 
also [18] for related results. We refer the reader to the recent work [2] for a 
comprehensive asymptotical analysis of more general continuous-time mod- 
els (including the Wiener disorder problem). The same work [2] can also be 
consulted for a brief survey and overview of the earlier work on asymptotical 
detection theory. 

In the aforementioned models, the observed Wiener process is the only 
source of information for detecting the change time. However, it is sometimes 
possible to observe the external factors that are responsible for the disorder. 
This is usually the case if we would like to detect, for example, a sudden 
change in financial data caused by major financial events/news, or damages 
in structures caused by earthquakes using continuously acquired vibration 
measurements (see [3], Chapters 1.2.5 and 11.1.4, for a discussion on vibra- 
tion monitoring in mechanical systems). Here, we consider such a setting 
where the underlying system is exposed to observable shocks/impulses, and 
the disorder happens at one of these shocks. 

Such a formulation is considered for the first time by [15] for a Brownian 
motion in a non-Bayesian framework, and under the assumption that these 
shocks form a Poisson process. Sections 4 and 5 in [15] derive an optimal so- 
lution for an (extended) Lorden criteria in terms of the (extended) CUSUM 
process. However, to our knowledge, no Bayesian formulation of this problem 
has been given yet. This formulation and its solution are the contributions 
of the current paper. It should be noted that under the distribution in (1.1), 
the unconditional distribution of Q is (zero-modified) exponential with pa- 
rameter Xp. Hence, our model can also be considered as a modification of the 
original formulation in [22]. The major difference is that we not only observe 
the underlying Wiener process but also the external causes of the disorder. 
In this "more informed" setting, the detection decision may improve greatly 
and this is indeed confirmed by our numerical example in Figure 1. 

As an additional remark, we would like to note that although the change 
can happen only at discrete points in time, a detection decision can be 
made at any time. Hence, the problem is rather a continuous-time problem 
as expected. It is essentially composed of a sequence of hypothesis-testing 
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problems: between two arrivals of the Poisson process, the observer tests the 
hypotheses 

Hq : drift = fio vs. Hi : drift = fii 

using the observations received from the Brownian motion. Indeed, on ev- 
ery inter-arrival period (T„,T„_|_i), the conditional probability process 11^ := 
P{0 < for t > 0, follows the same dynamics as those of the suffi- 

cient statistic Ht := IP{-ffi is true|J-j}, for t > 0, of the sequential hypothesis- 
testing problem in [22], Section 4.2; see Remark 2.1. If a decision has not 
been made by the next arrival time Tn+i, then the conditional probabilities 
are updated and the hypothesis-testing problem restarts again with new 
(updated) prior likelihoods. 

In this paper, we show that the problem of minimizing the Bayes risk in 
(1.2) is equivalent to an optimal stopping problem in terms of the condi- 
tional probability process 11 = {Iltloo, and it is optimal to stop the first 
time the process 11 exceeds a threshold tToo. The conditional probability 
process 11 is a jump-diffusion jointly driven by the observed Wiener pro- 
cess and the Poisson process [see (2.9) for its dynamics]. To compute the 
optimal threshold tToo and the optimal Bayes risk, we transform the corre- 
sponding optimal stopping problem into a sequence of stopping problems for 
the diffusive part of the process 11. Each of these sub-problems are solved by 
studying a free-boundary problem under a smooth fit principle, and these 
solutions are then combined using a jump operator; see Sections 3 and 4 
below for details. This approach is introduced for the first time by [7] in 
order to solve an optimal stopping problem involving a discounted running 
cost only. In our setting, the problem includes a running cost and a terminal 
cost, and involves no discounting. This requires nontrivial modifications of 
their arguments as illustrated in Sections 3 and 4. 

In Section 2 below, we formulate the problem as an optimal stopping 
problem for the conditional probability process 11, and we study the dy- 
namics of this process. In Section 3, we introduce a jump operator whose 
role is to incorporate the information generated by the Poisson process at 
every arrival time. Using this operator, we construct the optimal Bayes risk 
sequentially in Section 4, and we identify an optimal Bayes rule. Finally, in 
Section 5, we solve the variational formulation using the properties of the 
optimal solution given in Section 4. Appendices at the end include some of 
the lengthy derivations. 

2. Problem description. Let (fij'HjP) be a probability space hosting a 
Wiener process W and a simple Poisson process with arrival times (T„)n>o 
and rate A > 0. On this space, we have also an independent random variable 
with the zero-modified geometric distribution 

(2.1) P{C = 0} = 7r, P{C = n} = (l-7r)(l-p)'"-V for ah n G N 
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for some vr € [0, 1) and p € (0, 1]. In terms of these elements, we introduce a 
new M-i_ -valued variable 



(2.2) e:=^ra{c=.} 

representing the disorder time. Then, our observation process X = {Xt}t>o 
can be defined as 

(2.3) Xt:=Wt + n-{t- e)+ for all t > 0. 

In other words, as described in Section 1, the process X is a Brownian 
motion gaining a drift /i at time Q, and the change time Q has zero- modified 
geometric distribution on the Poissonian clock. With the notation in Sec- 
tion 1, we assume that /ip = and fj,i = fi^O without loss of generality. 

Let F = {J't}t>o be the filtration of the observed pair (X,N); that is, 
J-'t := a{Xs,Ns : s < t}, for t > 0. For an F-stopping time r, let i?(r, vr) denote 
the Bayes risk 

R{t, tt) := P"{t < G} + c • E^(t - G) + , 

in which P'^ is the probability measure P where C has the distribution in 
(2.1). The Bayes risk above includes the false alarm probability and the 
expected detection delay cost for some c > 0. Our objective in this problem 
is to compute 

(2.4) V(7r):=mi R(t,7:), 

reF 

and if exists, find a stopping time attaining this infimum. 

Using the standard arguments in [22], Chapter 4, we can transform the 
problem in (2.4) into an optimal stopping problem for the conditional prob- 
ability process defined as 

(2.5) Ut:=F{e <t\I't}, t>0. 

More precisely, the minimal Bayes risk in (2.4) is the value function of the 
optimal stopping problem 

(2.6) y(7r) = infE^ [ g(Us) ds + h(Ur) 

where ^(Tr) := c • vr and h{Tr) := 1 — vr. 

In Appendix A, we show that the process 11 has the characterization 



11/ = — , where 



(2.7) 
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in terms of 

(2.8) Lt:=exp|^Xt 

Using (2.7) and (2.8), we obtain 

(2.9) dUt = ijUt-{l - Ut-)dWt + p{l - Ut-) dNt, 

where Wt := Xt — fx f^^Ilsds, for t > 0, is a (P,F)-Wiener process. In Ap- 
pendix B, we also show that for t < si and t < S2 and for r,q £M, we have 

E[exp{ir{Ws, - Wt) + iq{Ns, - Nt)}\Tt] 

(2.10) 

= eM-yisi -t) + Ke"^ - 1)(S2 - t)}, 

which imphes that W and are independent. This further imphes that the 
process 11 whose dynamics are given in (2.9) is a strong Markov process. 

Remark 2.1. Between two arrival times, the process 11 satisfies dlit = 
^nt_(l — lit-) dWt, which coincides with the dynamics of the conditional 
probability process in the sequential hypothesis-testing problem considered 
in [22], Section 4.2. In that problem, an observer is given two hypotheses 

(2.11) i^o: drift =0 and i^i : drift = /i 

about an observed Wiener process. The hypotheses have prior likelihoods 
1 — vr and vr respectively, and the aim is to identify the correct one as soon 
as possible. 

In our problem, the change can happen only at one of the arrival times 
of the Poisson process. Hence, between two arrival times [Tni^n+i) the role 
of the process 11 is to indicate the posterior likelihood of the hypothesis 
Hi, whose initial prior is 11^,^ as of time In this setting, if a decision is 
made by the next arrival time, the hypothesis-testing problem terminates. 
Otherwise, it restarts with new priors 1 — Ht^^^ and IIt^^^j, respectively. 

Remark 2.2. Using its definition in (2.5), it can easily be verified that 
the process 11 is a bounded submartingale with a last element Hoo ^ 1- 
Moreover, thanks to bounded convergence theorem we have 

1 > E'^Uoo = lim E'^Ri = lim E''[lre<f>] 
= lim E"[E[l|0<t||iV„:n<t]] 
= lim E^[l-(l-7r)(l-p)^*] = l, 
which implies that Roo = 1, P'^-a.s., for all vr G [0, 1]. 




for t > 0. 
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The limiting behavior of 11 imphes that the exit time ?>. of 11 from an 
interval [0, r), for r G [0, 1), is finite P'^-almost surely, for vr € [0, 1]. Indeed, 
the dynamics in (2.9) give 



t/\Tr 



pIiu-{l-nu-)dWu 

+ / p(l-n„„)(diV„- Adn) 
Jo 

r-t/Vfr 

+ / \p{l-Iiu-)du 
Jo 



Since 11 is bounded, the first two integral has zero expectations. Moreover, 
for u<Tr, we have 1 — II^ > 1 — t, and this yields 



(2.12) 



showing that K'^Tr is uniformly bounded, for all tt € [0, 1] , thanks to mono- 
tone convergence theorem. 

3. Dynamic programming operator. The first arrival time Ti is a re- 
generation time of the conditional probability process 11. Therefore, if the 
process 11 has not been stopped yet, the minimal Bayes risk that one can 
attain starting from Ti should be computed by evaluating the function V{-) 
at n^^. This tells us that the value function should satisfy the dynamic 
programming equation 

rATi 



(3.1) V{n) 



inf E'^ 

reF 



Until the first arrival time, 11 coincides with a diffusion starting from 
Yq = TT and satisfying 



(3.2) 



dVt = fiYt{l-Yt) dWt for t > 0. 



Hence, a given stopping time r G F should coincide on the event {r < Ti} 
with another stopping time of the process Y . This observation suggests that 
the function V[-) should be a fixed point of the operator 

fTATi 

g{Yt)dt + l{,^T,}h{Yr) 



JH(7r) : = 



(3.3) 



inf E'^ 



+ l{r>T,}w{YT,+p{l-YT,)) 



which is obtained by replacing F in (3.1) with the filtration F^ of the process 
y, and V{-) with a bounded function w{-) on [0, 1]. Using the independence 
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of W and N, and the distribution of Ti we can rewrite this operator 



(3.4) JH(7r) = inf 



r e-%{Yt) + Au;(S(yt))] dt + e~^^h{Y^ 
Jo 



where S(vr) := vr +p(l — vr). 

In this section, we study the properties of the operator J for a suitable 
class of function w{-)^s. Under certain assumptions on w^-), we show that 
the infimum in (3.4) is attained by the exit time of the process Y from an 
interval of the form [0, r), and that the function J[u;](-) solves the variational 
inequalities of the optimal stopping problem in (3.4). Using the results of 
this section, we show in Section 4 that the function V{-) indeed satisfies 
V{-) = J[V]{-) as expected. 

Remark 3.1 . For a bounded function w : [0, 1] i-)- M+, we have < J[w]{-) < 
/i(-). Moreover for two bounded functions w;i(-) < W2i-), we have J[tfi](-) < 

Proof. The upper bound J[w]{-) < h{-) follows by taking r = in (3.4). 
Nonnegativity of J[w]{-) and the monotonicity oi w Jb^] obvious. □ 

3.1. Solving the optimal stopping problem in (3.4)- Below we solve the 
minimization problem in (3.4) under the following assumption. 

Assumption A1. The function w{-) is an arbitrary (but fixed) nonneg- 
ative and continuous function on [0, 1] bounded above by h{-). 

Let us define the functions 

^(vr) :=^™i(l -7r)i-™i and 

(3.5) 

,^(7r) :=7r™2(l_vr)^-™2 for ^€[0,1], 
where mi > 1 and m2 < are the roots of the quadratic equation 

(3.6) m(m—l) = —;r. 

The functions and r]{-) are respectively, the increasing and decreasing 
solutions (up to multiplication by a constant) of the equation Aof^n) = 
A/(7r), where is the infinitesimal generator of the diffusion process Y in 
(3.2); that is, Aofiir) := ^/^^^(l - nffin). It is easy to verify that the 
functions V'(') and r/(-) satisfy the boundary conditions 

V;(0+) = V'(0+) = = rj'il-) = r]{l-), 

(3.7) 

V'(l-) = V'(l-) = oo = ?/(0+) = r?(0+). 
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and that their Wronskian is mi — m2 ■ 

In terms of the drift r(-) = and the volatihty cr(7r) = /X7r(l — vr) of the 
process Y [see the dynamics in (3.2)], let S{-) denote the scale function 

^(Tr) := / Sidy), where ^((iy) := exp< / dz > dy = dy 

Jd [Jc cr\z) J 

for arbitrary c, d € (0, 1), and let M(-) be the speed measure 

M(d \ - - 

^""y'- a^y)S'{y) /.2vr2(l - vr)2 
for y e (0, 1). Feller boundary test at the right boundary {1} gives 

(3.8) / / S{dz)M{dy) = oo, j j M {dz) S {dy) = oo, 

Jc Jy Jc Jy 

and according to [10], Table 6.2, we conclude that the right boundary is 
natural. This implies that the process Y cannot reach the right boundary 
in finite time. On the other hand, the process {1 — Yt}t>o has the same dy- 
namics in (3.2) and by symmetry the left boundary {0} is also natural for 
Y. Indeed, by a change of variable in (3.8) as u = 1 — y and g' = 1 — z we get 
the Feller boundary test at {0} 

oo= r f S{dz)M{dy)= C ' r dq- '^'^ 

Jc Jy Jo Jo / 



Iq /z2n2(l — u)^ 



1— c /-u 

S{dq)M{du), 



JO 

oo=l J^M{dz)S{dy)=J^ /.Vd-.)^'" 

1 — c ru 

/ M{dq)S{du), 
lo Jo 

which gives the same conclusion for the left boundary. 

Remark 3.2. The process y is a bounded martingale [see (3.2)], and 
we have 

f oo 

-\tr 



POO 

/ e-%{Yt) + Xw{S{Yt))]dt 
Jo 





11 







e-^'[g{Yt) + X\\w\\]dt 
e-^'[E^g{Yt) + X\\w\\]dt 

/•oo 

/ e~^*'[g{7r) + X\\w\\]dt<oo 
Jo 
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Lemma 3.1. For < Z < r < 1, and let Ti^r be the exit time of the process 
Y from the interval {l,r). The expectation 



(3.9) Hi,r[w]i7r):=E^ 
has the explicit form 

Hl,r[w]{^) = ^(^) 

(3.10) +7?(7r 



e~%{Yt) + XwiE{Yt))] dt + e"^^'-/i(y,, J 



At;,; 



Ci + / ui[w]{y)dy 



Co 



U2[w\{y)dy 



^ ^^^^^ V'(7^)??(?•) --0(r-)7?(7r) ^ ^^^^'ilj{l)r]{7r) - V(7r)r?(/) 



ip{l)r]{r) - 'il^{r)ri{l) 
for TT G {l,r), in terms of 

a{y) + \w{8{y)) 



ij{l)r]{r) - 'il^{r)r]{l) 



(3.11) 



ui[w]{y) 
U2[w]{y) 

Ci 



(mi - m2)o-2(y) 
g{y) + \w{S{y)) 



(mi - m2)o-2(y) 
r]{l) f[ U2[w]{y) dy - // n2H(y) (i?/V'(0 



Tp{r)r]{l) — ij){l)rj{r) 



ipir), 



rjijr) 
tp{r] 



C2 



Clearly, Hi r[w]{-) is nonnegative, and we have Hi r[w]{TT) = h{Tr), for vr ^ 
(Z,r). 

Proof. Nonnegativity of Hi^riMi') ^iid the identity Hi^riMi') = ^(Oi 
on [0,1] \ {l,r), are obvious. For vr € {l,r), let /(•) denote the function on 
the right-hand side in (3.10). Direct computation shows that /(•) satisfies 

{-X + Ao)f{Tr)+g{Tr) + Xw{S{y))=0 on ^G(/,r), 

with boundary conditions /(/+) = h{l) and f{r—) = h{r). Moreover, its 
derivative (with respect to tt) is 



V''(^) 



Ci+ I ui[w]{y)dy 



+ ij'(ir) 



ip{l)r]{r) - V{r)r]{l) 



C2- U2[w]{y)dy 

J n 

V'(0?/(vr)-V''(vr)??(0 



'tp{l)i]ir) -tpir)rj{l) 
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which is bounded on [l,r]. Also, observe that the exit time Ti^r of the regular 
diffusion Y is finite and ^) = fiXri ,.)) P'^-almost surely for all vr € (0, 1). 
Then, by applying Ito's rule, we obtain 

= /(7r)+E- r\-^\-\ + Ao)f{Yu)du 
Jo 

= f{7r) - e~^*[g{Yu) + Xw{S{Y^))] du, 

Jo 

and this shows /(•) = Hi^riwji-) on {l,r). □ 

Lemma 3.2. For < r < 1, and Tr := inf{t >0:Yt>r}, let us define 



Hr[w]{TT) :=E^ 

(3.12) 



e-^'[giYt) + Xwi§iYt))]dt 



+ e-^^^h{Yr^[ 



^€[0,1], 



which clearly equals h{-), for n >r. For vr E (0,r), the function Hr[u!]{-) can 
be computed by taking the limit of (3.10) as / \0. That is, 

Hr \w] (vr) = lim Hi r \w] (vr) 

l\0 ' ^ ' 

(3.13) =V'(7r)f-^/ U2[w]{y)dy+ [ ui[w]{y) dy + ^^''^ 



i^ir) Jo Jtt '^{r] 

/"TT 

+ r]{TT) / U2[w]{y)dy. 



The expression in (3.13) is twice- continuously differentiable [on {0,r)] and 
solves 

(3.14) (-A + Ao)Hr[w]iTT) + g{Tr) + Xw(S{y)) = 0. 
Moreover, the function Hr{-) is continuous on [0,1] with 

(3.15) lim Hr[w]{7r) = iu{p) = Hr[w]{0). 

7r\0 

Proof. The point {0} is a natural boundary for Y; therefore, we have 
Tr = lim;\^o ''"(.ri P'^-almost surely, for vr G (0,r). Then, the dominated conver- 
gence theorem (see Remark 3.2) implies that Hr[w]{'iT) = lim;\^o-f^^,^M('^)• 
To compute the limit of Hi^r['w]{TT) as / \ 0, we first observe 

limfofO '^*-^^^^^^ - V'l^)^!^) _^ s V^(0^(7r) --0(7r)r?(/) 

l\0 ■il;{l)r]{r) - 'ip{r)r]{l) 'il;{l)r]{r) - il){r)r]{l) 

(3.16) 

If ^^(^) 
= V'(^)-7^- 

ip^r) 
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Moreover, since < g{-) + Xw{S{-)) < c + A||u;||, we have 





c + A||it;|| rip"{y) 




for TT < 1 



and using (3.11) we get 




■r 



U2[w]{y)dy. 



Finally letting / \ in (3.10) and using the limits found in (3.16) and (3.17), 
we obtain the expression in (3.13). It is evident that this expression is twice- 
continuously differentiable. Moreover, by direct computation [using (3.11)] 
it can be verified easily that it solves the equation in (3.14). 

Clearly, Hr[w]{-) is continuous on (0,r) and (r, 1). The continuity at {r} 
can be checked by letting vr r in the expression given in (3.13), which 
goes to h{r). To establish (3.15), we first note that If = 0, for all t > 0, if 
Yq = IT = 0. This implies 



Uo J 

On the other hand, applying L'Hopital rule and using the explicit form of 
ip{-) and r]{-), we obtain 



Since mi ■m2 = —2fj?/X [see (3.6)], taking the limit in (3.13) gives w{p), and 
this concludes the proof. □ 

Lemma 3.2 shows that at the point vr = r, we have (Hr[w]y {r+) = — 1 and 
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Since the Wronskian ip'{r)r]{r) — il){r)'q'{r) equals mi — m2, we can rewrite 
the left derivative as 

{Hr[w])'{r-) = A_[-j'^ ^^[^^^^ + Au;(S(y))] dy + i^'{r)h{r)^ . 

Hence, the derivative is continuous at vr = r if and only if 

''^^My) + ^^i^iy))\ dy + i^'ir)h{r) + V(r) = 

(y) 

(3-18) - 

^ B[w]{r):= r^^[-g{y)-Xw{Siy)) + Xh{y)]dy = 0, 

Jo ^ yy) 

where the second equation follows after noting that 

^'(r)/i(r) + ^(r) = f h{y) [2X^{y)/a^ {y)] dy, 
Jo 

which can be verified using Xip{-) = Aoip{-). 

Lemma 3.3. If w{-) is concave, then the function — g(7r) — Xw{S{Tr)) + 
Xh{7r) has a unique root d[w] G (0, 1). The function vr i-)- Blw]^^) equals zero 
for TT = 0, strictly increases on {0,d[w]) and strictly decreases on {d[w],l) 
with limT^yi B[w]{tt) = — oo. Hence, there exists a unique point r[w] € {d[w], 1) 
at which B[w]{r[w]) =0. 

Proof. The function vr h> -g{7T) - Xw{§{7t)) + Xh{7T) = cvr - Aw(S(7r)) + 
A(l — vr) is convex and continuous on [0, 1]. At the point vr = 0, it equals 
X{—w{p) + 1) > X{—h{p) + 1) > 0; and at vr = 1, its value is — c — Xw{p) < 0. 
Hence, there exists a single point d[w] G (0, 1) at which it is zero. To the 
left of this point it is positive, and to the right it is negative. Therefore, 
TT B[w]{tt) is zero at vr = 0, strictly increases on (0, and strictly 

decreases on {d[w], 1). Also, observe that, for vr < 1, 

|5H(vr)|<(c + 2A) r^^dy='-±^ T = ^^'(vr) < oo 

Jo <^ {y) X Jo A 

and 

my) 



21 \v 9{y) - ^'WiSiy)) + Xh{y)]dy 

d[w]+5 <^^{y) 

< ( rnin {-^(vr) - A^.;(§(vr)) + A/i(^)}) • 



2^(y) , 
-^T-rdy 

d[w]+5 [y) 

min ^ |-5(vr) - Xw{§{n)) + Xh{7r)}) ■ 



-OO 
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for all (5 € (0, 1 — where the last equality follows using (3.5). Hence, 

we conclude that B[w]{tt) goes to — oo as vr ^ 1, and this implies that it has 
a unique root r[w] G {d[w], 1). □ 

Remark 3.3. For two concave functions wi{-) < W2{-) satisfying As- 
sumption Al, we have > B[w2]{-)', therefore r[wi] > r[w2]- If we 
select the zero function (which equals zero on [0,1]), direct computation 
yields 



Ml-.) 

and for /i(vr) = 1 — vr, we get 



vr(l — vr) 
Hence, we have the bounds 



-vr( (mi - 1)-^ + mi ) + mi 



-vr( (mi — 1)— + mip ) + mip 



(3-19) 7 <-M<7 • 

^ ^ (mi - l)(c/A) +mip ~ ^ ^ ~ (mi - l)(c/A) -l-mi 

Observe that, if the function w{-) is concave, Hr[^][w]{-) is continuously 
differentiable on (0,1). On (r[i(;],l), H^^^^[w]{-) coincides with h{-), and 

(-A + Ao)Hr[u,] [w]{tt) + g{7r) + A'u;(S(7r)) = -Xh{7r) + ^(vr) + Au;(S(vr)) > 0, 

since d[w] <r[w]. 

On (0,r[tt;]), the function [ii;](-) solves {— X + Ao)Hj.[u!][w]{7r) + g{ir) + 
A?i;(S(vr)) = 0. In Appendix B, we also show that 

(3.20) XHr[w][w]{TT) - g{TT) - Xw{S{tt)) < forO<vr<r[u;]. 

Since AoHj.[uj][w]{7r) = (cr^(vr)/2) • (//j,[^][ti;](vr))", the inequality in (3.20) 
implies that H^^^^[w]{-) is strictly concave and -?/j.[to]M(') < ^(O (0,r[t(;]). 

Finally, the (strict) concavity on (0,r[tt;]) and the "smooth-fit" at 
imply that Hr[uj][w]{-) is also concave on (0,1). The following remark is a 
summary of the analytical properties of Hr[^]['w]{-) described above. 

Remark 3.4. Suppose that the function w{-) is concave. Then, //^[to] 
is nonnegative, continuous and concave on [0, 1]. It is continuously differen- 
tiable on (0,1), twice-continuously differentiable on (0, 1) \ {r[i(;]}, and it 
satisfies 



(3.21) 



(-A + A)^rMHW+5(^) + Au;(S(vr))>0i ' ^ ^' ^' 

r //,,[^]H(^)<M^) 1 vrG(OrN) 

l(-A + A)^r.MH(vr)+5(^) + Au;(S(vr))=0i ' ' ^ 
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Lemma 3.4. Ifw{-) is concave, we have J[w]{-) = Hj.[^j['w]{-) , andTr^^j := 
inf{t >0-Yt>r[w]} is an optimal stopping time for (3.4)- 

Proof. For vr € (0, 1), let r be an F^-stopping time, and t/^^ be the exit 
time of Y from (/, r) for < / < r < 1. Then, by Ito's rule 

= //,[^]H(7r)+ / e~^\-\ + Ao)H,^^^[w]{Yt)dt 
Jo 

+ / e-^'a{Yt){H,.^,,^[w]y{Yt)dWt. 



The function Hr[.^jj][w]{-) is continuously differentiable on (0, 1). Its derivative 
is therefore bounded on [l,r] and ||o"(-)|| < |^|. Then, taking expectations 
above gives 

= Hri^^[w]{7T)+E^ / e-^\-X + Ao)Rr[^^[w]{Yt)dt 
Jo 

> H,[^^[w]{7t)-E^ / e-^\g{Yt) + \w{S{Yt))) dt, 
Jo 

where the inequality is due to (3.21). Since both boundaries are natural, we 
first let r 1 and then / \ to obtain 

(3.22) 

> H,.[^]{w]{7r) - r e-^\g{Yt) + Au;(S(yt))) dt 
Jo 

thanks to dominated convergence theorem (see Remark 3.2), and this shows 
H,^^^[w]{-)<J[w]{-) on (0,1). 

When we repeat the steps above with r = r^f^o] = inf{t > : > r[tt;]}, the 
inequalities become equalities again by (3.21). Hence, J[w](-) = [ii)](-) 
on (0,1). 

If = vr = 0; then Yt = 0, for t > 0, and 

JH(0) = infE^[A'u;(S(0))(l - e-^^) + e-^^/i(0)] 

r 

= w{S{0))=wip) = H,[^^{0), 

thanks to Lemma 3.2 [note that w{p) < h{p) < /i(0)]. Moreover, this value is 
attained by selecting r = oo = r^-^uiy Similarly, if Yq = 1; we have J[i(;](l) = 
/i(l) = = -ff^[^](l), which is attained by r = = t^[^]. □ 
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4. The value function and an optimal detection rule. Using the dynamic 
programming operator J, let us define the sequence of functions 

vo = h{-) and ■u„+i(-) := J[vn]{-) = i^r[i.„] K](-) for n G N. 

Remark 4.1. The sequence (wn)neN is nonincreasing, and each element 
of the sequence is a nonnegative, continuous and concave function on [0, 1]. 

Proof. We have vi{-) = J[h]{-) < h{-) = fo(-)i where the inequality fol- 
lows from the definition of the operator J in (3.4). Next, assume that Vn{-) < 
Vn-i{-), for some n G N. Then Remark 3.1 implies = J[frt](-) < 

J[un-i](-) =Vn{-), and this shows that the sequence {vn)neN is nonincreas- 
ing by induction. Finally, since vo{-) = h{-) is nonnegative, continuous and 
concave, these properties also hold for each n G N, by induction thanks 

to Remark 3.4. □ 



For n G N, let 7r„ := r[7;„_i] be the solution of the equation B[vn-i]{r) = 
[see (3.18)]. Since Vn-i{-) is concave and satisfies Assumption Al, this equa- 
tion has a unique root on (0, 1) thanks to Lemma 3.3. Moreover, Remark 3.4 
and Lemma 3.4 imply that Vn{-) is continuously differentiable on (0,1), 
twice-continuously differentiable on (0, 1) \ {vr^} and solves the variational 
inequalities 



f„(7r) = h{-n) 
(-A + ^o)t'n(vr) + g{-K) + A7;„_i(S(7r)) > 

7;„(7r) < /i(7r) 
(-A + A)t'n(vr) +5(vr) + A7;„_i(S(7r)) = 



vr G (7r„, 1), 



vr G (0,vr„) 



Observe that 7r.„ = inf{vr G [0, 1] :Vn{T^) = h{'n)}; hence, {vr„}„gN is nonde- 
creasing. 

Let Voo{-) := infn,eN^'n(') be the pointwise limit of {vn)n&n- Then domi- 
nated convergence theorem gives 



(4.1) 



inf J[t;„_i](vr) 

nGN 



inf inf E'^ 
inf infE'^ 

rSF^ nGN 



inf E'^ 



-At 



g{Yt) + \vn^i{^{Yt))]dt- 



-At 



e-^*b(^t) + \vn^i{^{Yt))] dt + e-^-/i(n-) 



e-^'[g{Yt) + \v^{^{Yt))] dt + e-^^h{W^) 



which shows that the function Voo{ 



is a fixed point of the operator J. 
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Lemma 4.1. The sequence {vn)n>i converges to Vooi') uniformly on 
[0,1]. More precisely, we have 

(4.2) vM < M^) < Voo{7t) + (1 - pTil - tt) 

for all n G N. 

Proof. The first inequality in (4.2) is immediate since the sequence 
{vn)n£'N is nonincreasing. The second inequality is also obvious for n = 
(•) = inf„gN^^n(-) > 0. Assume the second inequality holds for some 
n G N. This implies that u„(§(7r)) = fn(7r + p{l — tt)) < Voo{tt + p(l — vr)) + 
(1 -p)"(l -7r-p(l - vr)) =Uoo(§(vr)) + (1 - p)"+i(l - vr). Then we have 

Vn+iiir) = J[-Un](vr) 



inf E'^ 



< inf E'^ 



< inf E'^ 



r e-%{Yt) + \v^{S{Yt))] dt + e-^^h{U; 
Jo 

r e-%{Yt) + Xvo.{S{Yt)) + A(l - p)^+\l - Yt)] dt 
Jo 

+ e-^^/i(n^ 

e-%{Yt) + \voo{S{Yt))] dt + e-^"/i(n^ 



+ E'' 



poo 

/ e~^'X{l-p)"+\l-Yt)dt 
Jo 



Since foo(') satisfies Uoo(') = J['Voo]{-), the last inequality gives 



Vn+i{7r)<vM+ / e~^'\{l-p)^+'E^[l-Yt]dt 
Jo 

= T;oo(vr) + (l-p)"+Hl-7r), 

where we used the martingale property of Y to justify the last equality. This 
shows the second inequality in (4.2) for n + 1, and the proof is complete by 
induction. □ 

Corollary 4.1. The uniform convergence in Lemma 4.1 implies that 
Vooi') is continuous on [0,1]. Moreover, as the infimum of nonnegative con- 
cave functions 't;„(-)'s, it is also nonnegative and concave. 



Corollary 4.1 and the identity Voo{-) = J[voo\{') [see (4.1)] allow us to con- 
clude that foo(-) is continuously differentiable on (0, 1) and twice-continuously 
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Fig. 1. We present a numerical example where fi — 1, X = 2, p — 0.5 and c = 0.5. Panel 
(a) illustrates the sequential approximation of the optimal Bayes risk. The functions Vn{-), 
for n < 10, are computed by first finding the threshold 7r„ and then evaluating the exit 
time expectation ^^7r„ [?'7i](-) in (3.13) for tt <TVn . The convergence is uniformly fast as 
given by Lemma 4-T For n = 10, we have \\V — vio\\ < 9.76 ■ 10^**. Panel (b) compares 
two information levels on this detection problem. Recall that unconditional distribution 
of the change time is exponential with parameter \p=l. If we only observe the Wiener 
process (given this prior distribution) without observing the Poisson process N, then we 
are in the framework considered by [17], Section 6.22. The function Vexp{-) is the value 
function corresponding to this ^Hess information^^ setting. It is computed by evaluating the 
expressions in [17], pages 311-312, with the values of fi and c given above. The figure 
illustrates that another observer who is also presented the process N performs significantly 
better in detecting the change. 



differentiable on (0, 1) \ {vToo}, where tToo := r[voo] is the unique root of the 
equation B[voo]ir) = defined in (3.18). Furthermore, Voo{-) satisfies 

f Voo(7r) = /i(7r) 

\ (-A + Ao)voc{tt) + g{7r) + Avoo(S(vr)) > 

(4.3) 

I Voo(vr) < h{TT) 

\ (-A + Ao)voo{tt) + g{7r) + Avoo(S(vr)) = 

which also imphes that tToo = inf{7r € [0, 1] :Voo{it) = hi^n)}. Since Vn{-) \ 
v{-), we have 7r„ /^tToo- 

Proposition 4.1. The function Voo{-) is the value function V{-) of the 
optimal stopping problem in (2.6), and the first entrance time tv^ of the pro- 
cess n to the interval [tToo, 1] is an optimal solution for the change- detection 
problem in (2.4)- 

Proof. The claim is obvious if Ho = vr = 1; both Uoo(l) and ^(1) are 
nonnegative and bounded by h{l) = 0, which is also the expected reward in 
(2.6) by stopping immediately. 



TT G (vToo, 1) 



IT € (0,7roo), 
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For vr G (0, 1) and < Z < r < 1, let r[o,/] and T[r,i] be respectively, the 
entrance times of the process 11 to the intervals [0, and [r, 1]. Also, define 
T7,r ^=''^[0,/] /\^r,i] - Then for an F-stopping time r, Ito's rule gives 



(7r)+ / [{-X + Ao)Voo(Jlu-) + XVoc{S{Uu-))]du 

Jo 

+ [ '^\Uu-{l-Uu-)vU^u-)dWu 
Jo 

+ / [voo{^{IVu-))-vU^u~)]{dNu-\du). 
Jo 



Since the function v^x, is bounded, the stochastic integral with respect to 
the martingale {Nt — At}t>o is a square-integrable martingale stopped at 
T ATi^r [whose expectation is finite due to (2.12)]. Similarly, so is the in- 
tegral with respect to W as v'^ is continuous and bounded on [l,r]. Then 
taking expectations, we obtain 



(4.4) 



= ?;oo(vr)+E" / [{-X + AQ)vo^{Uu-) + Xvoo{§{Uu^))]du 
Jo 

>Vocin)-E^ g{Uu-)du 
Jo 

= ?;oo(vr)-E" / g{Uu)du 
Jo 



thanks to the inequalities in (4.3). 

The left boundary {0} is natural for the diffusion in (3.2). Between two 
arrivals of A^, the process 11 follows these dynamics, and at an arrival time 
Tn it jumps to the right by an amount of p{l — Htu)- Hence, as we let 
^ \ 0, T[ofl goes to oo thanks to strong Markov property, and Ti^r /^T^[r,i]- 
Moreover, limt-^oo^t = 1) and lit < 1 [since <l>t < oo in (2.7)] for finite t, if 
vr < 1. Hence, as r 1, we have T^r,!] cxo. Therefore, when we let Z \, and 
r 1 in (4.4), bounded convergence and monotone convergence theorems 
give 

(4.5) E''Voo{Ilr) > VooiTT) - / giU^) du. 

Jo 

Also note that we have E'^/i(n^) > W^Voo{^t)- Then we obtain 



E" 



g{Ylu)du + h{nr) 



> foo(vr), 
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which imphes that fooler) < ^(^r) on (0, 1). 

When we replace r in (4.4) with the entrance time t-k^, the inequahty 
in (4.5) becomes an equahty. Then the equahty W^hijl^^^) = 'K^Voo(J^T-n^) 
yields 



(4.6) 



i;oo(vr)=E" 



and this implies V{'i:) = t'oo(7r), for vr G (0, 1). 

To show the same equality for Ho = vr = 0, we first note that lit = for 
t <Ti, and 11^^ =p if the process 11 starts from the point {0}. Also note 
that the identity Vooi') = J[voo]i-) implies t'oo(O) = Voo(p) [see (3.3)]. Then 
for an F-stopping time r, by modifying the arguments above, we get 

E°Voo(n^A(r,,ro6»Ti)) 

/ [(-A + A)t'oo(n„) 

/ g{Uu)du 

rrA(fi,^o6»Tj) 

g{Ilu)du, 



(4.7) 



i^oo(0)-E^ 



where 6 is the time-shift operator. Letting I \ and r 1 in (4.7), and 
using the inequality E°/i(n^) > E°t;oo(n^), we obtain Voo{0) < 1/(0). 

Replacing r above with ^j, we get equalities in (4.7). Then, letting / \ 

0, r 1, and using the equality E°/i(n^j^^ ) = E°?;oo(n^(^^ we obtain 
(4.6) for vr = 0. Hence, we have Voo{0) = V{0), and this concludes the proof. 
□ 



Remark 4.2. For e > 0, let us fix n e N such that n > ln(e)/ln(l - p) 
and Vn{-) < Vqo{-) + e, on [0,1]. The exit time 7v„ of 11 from the interval 
[0, TTn) = {vr € [0, 1] : fn(vr) < h{Tr)} is e-optimal for the problem in (2.6). That 
is, 



(4.8) E'' 



g(nt)dt + h{U^^, 



<V{tt)+£ for all ttG [0,1]. 



Proof. For vr > 0, a localization argument and Ito's rule (as in the proof 
of Proposition 4.1) give 



E'^r;oo(n= )=?;oo(vr)+E^ 



[(-A + Ao)v^(n^-) + A?;oo(S(n,u_))] du 
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Jo 

where the last equahty foUows from (4.3) (recah that vr^ < tToo)- Note that 
r,r„ < C!0 and f„(n;f^^) = h(Il:^^^), P'^-almost surely. Then the inequality 
Vni-) <Voo{-) + £ yields 

Jo 

and (4.8) follows. 
For vr = 0, we have 

eO / 5(n„) du + hilir^^ ) = eO / g{Iiu) du + h{Ii^^^,er, ) 

Jo JTi 

<V{p)+e = ViO) + e, 

where the inequality is due the strong Markov property (and also the result 
already proved above for tt = p> 0), and the last equality follows from the 
identity V{0) = J[V]{0) = V{p). □ 



5. Variational formulation. In this section, we solve the variational for- 
mulation of the problem where the objective is to minimize the expected 
detection delay E'^(r — Q)'^ over all F-stopping times for which the false 
alarm probability ¥^{t < Q) is less than or equal to some predetermined 
value a £ (0, 1). The optimality of r = is immediate when vr = 1; hence, 
this case is excluded below. 

When 7r€(0,l), r = Ois also an optimal solution if a > 1 — vr. On the 
other hand, if vr = and a> 1—p, the first arrival time Ti of N yields a false 
alarm probability of 1 —p and its expected delay is still zero [see (2.1)-(2.2)]. 

If none of these trivial cases hold, we can find an optimal stopping time 
(for the variational formulation) using the solution of the problem in (2.4) as 
explained in [22]. More precisely, let 7roo(c) be the optimal threshold found 
in Section 4 as a function of c, and let t^^(c) be the corresponding exit time 
of the process 11. For a given value of a, assume there exists a value of c > 
such that the false alarm probability P'^(r^^(c) < ©) = ^^^0^7^ ^^^) equals 
a. Then tv^(c) solves the variational formulation. Indeed, the optimality of 
'^7roo(c) original problem in (2.4) implies that, for any F-stopping time 

r, we have 

cE^(?,^(,) - 6)+ + P"(?.^(c) < 6) < cE^T - G)+ + P^(r < 9). 



22 S. O. SEZER 

Since P'^(T[7r^(c),i] <@) = a, its expected detection delay has to be minimal 
compared to other stopping time r's for which ¥'^{t <Q) <a. 

In this section, we show that c i— > E'^/ifn= , , ) is a continuous function of 
c S (0, oo) with limits (0) and 1 — vr (1 — p) as c \ and c oo, respectively 
if vr > (vr = 0). Hence, for a given pair {TT,a) the arguments in [22] work, 
and T7r^(c) is optimal for the value of c, for which E,'^h{Il^^ ^^^) = a. 

5.1. False alarm probabilities. For a given threshold r G (0,1), let ?> := 
inf{t > : lit > r} be the exit time of 11 from the interval [0, r), and let 

(5.1) Fri7r):=F^{Tr<e)=E^h{U^^) 

be the corresponding false alarm probability. On the event {tv <Ti}, the 
exit time of 11 coincides with the exit time Tr of the process Y [in (3.2)], 
and we have /i(nf^) = h{YT-,.). On the other hand, conditioned on {% ^Ti}, 
strong Markov property implies that the false alarm probability should be 
computed by evaluating the function Fr{-) at the point Uti- Therefore, we 
expect the function Fr{-) to solve 

FriiT) = E^[l{,^^r,}HYrr) + 1k>Ti} • FriYr,- +p(l - Yt,-))] 

f-Tr 



■h{Yr^) + r Ae-^* • FriS{Yt)) dt 
Jo 



=:FW[f,,](^), 



where Hj^\-]{-) denotes the operator Hr[-]{-) in (3.12)-(3.13) with c = [see 

also (3.11)]. Hence, if we apply the operator Hr^\-]{-) successively starting 
with a suitably selected initial function, the sequence that we obtain should 
convergence to the function Fr{-). Indeed, in Appendix A. 2, we show that 
the sequence constructed as 

(5.2) uoA-)=H-) and n„+i,,(-) = //("^ [tx„,,](-) for n G N, 
is nonincreasing and converges uniformly to Fr{-) with error bounds 

(5.3) 0<Fr(7r)<u„,,.(7r)<Fr(7r) + (l-p)"(l-7r) for aU n G N. 

It can easily be verified that the results in Lemmas 3.1 and 3.2 still hold 
for c = 0. Hence, on the region {(vr, r) : vr < r}, n„,^j,(7r) has the form 



V ipir) Jq nil - m2 
(5.4) ^ r ^n-i.(S(y)) ^.(^^,^^%) 



mi — m2 

thanks to identities ^oV'(') = -^V'(') and ^o??(") = M(")- On the region {(vr, r) : 
TT > r}, obviously, we have Mn^r(7r) = 1 — tt. 
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Lemma 5.1. For each n G [0, 1], the functions r ^ Un,r{'^), for n € N, 
and r i— )■ Fr{'K) are continuous on r G (0, 1). 

Proof. The result is obvious for vr = 1, since n„,^r(l) = -Fr(l) = 1) for all 
r € (0, 1). To prove the result for vr < 1, we will show that (vr, r) i— )■ iin,r(7r) is 
jointly continuous on (0, 1) x (0, 1). However, observe that Un^ri"^) = 1 — vr, 
for vr < r; and tin,r(0) = n,„_i^,.(p), for r > vr = thanks to (5.4) [see also 
(3.15) in Lemma 3.2]. Then direct computation gives 

lim n.„ ,.(0) = lim u.„_i^(p) = 1 - p < 1 = ii„ o(0), 

which shows that (vr,r) i-^ Un^ri"^) is not continuous at (0,0). 

Clearly, (vr,r) i-)- tio,r('?'") = 1 — vr is continuous on (0, 1) x (0, 1). Suppose 
that the result holds for some n € N. On the region {(vr, r) : vr > r}, M„+i^r(vr) 
again equals /i(vr), and continuity is immediate. 

Also, using the joint continuity on (0, 1) x (0, 1) of the bounded function 
Un,ri'^) [and the boundary conditions ^'(0+) = and ?/(l — ) = 0], it can 
be verified that the expression in (5.4) is jointly continuous on {(vr,r) € 
(0, 1) x (0, 1) : vr < r}. When we let r n in (5.4), direct computation gives 

??(vr) r Un,r{Hy)) ,/// N , , H'^) 



( r?(vr) r n^%)^ 
V V'Itt) Jo [mi -1712) 



'0(7r) 



+ ^^"Vo (m,-m,) ^ iy)dy = h{.). 

This implies that u„+i.r(vr) is jointly continuous on (0,1) x (0,1), and the 
result is true all n S N by induction. 

For vr = and n € N, we have Un+i,riO) = Un,r{p), and the continuity of 
r I— > Un+i,r{0) follows from the first part of the proof. Finally, the uniform 
convergence in (5.3) imply that r Fj.{ii) is also continuous, for each vr € 
[0, 1], and this concludes the proof. □ 

By the definition of F^^tt) given in (5.1), we have 

lim Fr{'K) = 1 — vr for vr > and 

(5.5) 

lim Fr(0) = l-p, 

where the second limit follows from the behavior of the process IT at {0}. 
That is, if Ho = 0, the process remains at this point until the first arrival 
time Ti, and then it jumps to the point {p} [see (2.9)]. Also note that, 
for all vr S [0,1] and r < 1, the exit time ?> is finite P'^-almost surely, and 
I^Tr € (r, r + p(l - r)) . Hence, 

(5.6) lim Fr(vr) = lim £^"[1 -n^rj =0 for vr > 0. 
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Remark 5.1. The optimal threshold of the Bayesian formulation is a 
nonincreasing and continuous function of the cost parameter c. If we let 
7roo(c) denote the optimal threshold as a function of c, we have 

(5.7) lim 7roo(c) = 1 and lim 7roo(c) = 0. 

The limits in (5.7) can be obtained using the bounds in (3.19). Mono- 
tonicity of '/roo(c) in c is also obvious and follows from (1.2) and Remark 3.3. 
For the proof of the continuity of c i-)- '/roo(c), Appendix B can be consulted. 

Lemma 5.1 and Remark 5.1 imply that F^^(^^-j{7r) is continuous with re- 
spect to c on (0, oo). Moreover, thanks to (5.5)~(5.6) we have 

lim F_ (r^M = lim F»,(7r)=0, with 



1™ P^oo{c){t^) = i^r(vr) = 1 - TT 

c^oo ^ ' r— >0+ 



for vr > 0, and 



^hm F^^ (,) (0) = ^Ihn Fr (0) = 0, with 
limF,^(,)(0)= lim i^,(0) = l-p. 

c— >oo ^ ' r— >0+ 

Hence (excluding the trivial cases) it is possible to pick a value of c such that 
the exit time t^^[c) ^ false alarm probability a and solves the variational 
formulation. 

APPENDIX A: ON THE CONDITIONAL PROBABILITY PROCESS 

A.l. An auxiliary probability measure and the proof of (2.7). Let (17, T-L, 
Pq) be a probability space hosting the following independent stochastic ele- 
ments: 

• a Wiener process X (with = 0), 

• a simple Poisson process with arrival rate A and arrival times (r„)„>o, 

• an integer valued random variable with distribution Po{C = 0} = vr and 
Po{^ = ra} = (1 - 7r)(l - p)"-ip for n € N, 

• a random variable O defined as in (2.2). 

Let G = {G}t>Q be an extended filtration such that Qt := a{Xs.,Ns.,C, : s < 
t}. In terms of the process Lt = exp{//Xj — fj,'^t/2}, we introduce a new 
probability measure P whose Radon-Nykodyn derivative is 

Lt 



*■ dPo 



\e>t} + ^{e<t}j^- 



Under the new measure, the process X is a Brownian motion that gains 
a drift ;U at O. The random variables Q and O have the same distribution 
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under P since C ^ and Zq = 1. In other words, we have the same setup 
described in Sections 1 and 2. 

Let us now define the hkeHhood ratio process 

^ _ F{Q<t\J't} _ MZtl{e<t}\J't] 
*■ F{Q>t\Tt} Eo[Ztl{e>t}\J'ty 

where the equahty fohows from Bayes' rule. Using the independence of X, N 
and C under ¥q, we obtain 

Eo[Ztl{e<t}l-^t] = -^Lt + (1 - vr) - py~^p-^ 

and 

Eo[Ztl{e>t}\:^t]=n[l{e>t}\J't] = (1 - 7r)(l - p)^*. 
Therefore, we have 



* = (1 - p)Nt [ + ^ 

and this proves (2.7) 



A.2. Constructing the exit time (false alarm) probabilities. Let Hj^^ 
denotes Hr defined in (3.12) with c = 0. It should be noted that the proofs 
of Lemmas 3.1 and 3.2 use only the continuity of the given function w{-) 
and the bounds < w{-) < h{-). Hence, they also cover the case c = 0. 

Remark A.l. The operator H^^^ is monotone in w{-); that is for wi{-) < 
W2{-), we have hI^\wi]{-) < Hi^\w2]{-)- Moreover, if w{-) is a continuous 
function bounded as <w{-) <h{-), then so is [«;](•). 



Proof. The claim on monotonicity is obvious. Given w{-) continuous 
id bounded asO <w{-) < h{-), H^°\w]{-) is again continuous by Lemma 3.2. 
Since the process Y in (3.2) is a bounded martingale, we have 

/•oo 

e{TT) :=E^ / e-^^Xh(S{Yt))dt 
= E 



/•oo 

^ e-^'X{l-p)il-Yt)dt 
Jo 



(l-p)(l-^). 
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Then, for a function w{-) bounded as < w(-) < /i(-), strong Markov prop- 
erty gives 



= i{7r)+E^e-^^^[h{Yr^)-£{Y^^)] 
Hence, < HiP\w]{-) < h{-) again. □ 



Using Remark A.l above, it can be shown by induction (as in the proof 
of Remark 4.1) that the sequence 

(A.l) UQ^r{-) = h{-) and Un+i,r{-) = H^^\unA{-) fornGN, 

is nonincreasing, and each function is nonnegative, continuous and bounded 
above by /i(-). The pointwise hmit Uoo,r(0 := infngN ^^n,r(') exists and it is 
bounded as < tioo,r(') < 



Remark A. 2. The Hmit function itoo,r(') solves Uoo,r(') = Hi- [noo,r](')) 
on [0,1]. 



Proof. The proof fohows from a straightforward modification of (4.1) 
by replacing v^, Vn, t with Uoo^r, Un,r-, Tr respectively. □ 

Remark A. 3. The sequence defined in (A.l) converges uniformly on 
[0, 1], and we have the explicit error bounds 

(A.2) 0<n„,,.(7r)-Moo,r(vr)<(l-p)"(l-7r) for n € N. 

Proof. We will establish the inequalities above by modifying the proof 
of Lemma 4.1. 

The first inequality in (5.3) is obvious. The second inequality follows im- 
mediately for n = since < noo,r(') ^ ^{')- Assume it holds for some n E N. 

Then using the induction hypothesis and the identity tioo,r(') = Hf'^ [uoo,r]i')^ 
we have 




+ 




e-^*A[noo,r(S(l^t)) + (1 - pT^\1 - Yt)] dt 
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<noo,r(-)+IE" 







= ^oo,r(-) + (l-Pr+Hl-Vr), 

and (A.2) follows. □ 

Corollary A.l. Since, each Un^r{') is continuous, so is Uoo,r(') thanks 

to Remark A. 3. Then, the identity Uoo,r(') = Hi^\uoo,r]{-) cind Lemma 3.2 
imply that the function Uoo,r(') solves 

(A.3) (-A + A)^^oo,r(vr) + Auoo,r(S(y)) = on(0,r), 

and TT = 0, we have ttoo,r(0) = Uoo,r{p) [see (3.15)]. 

Proposition A.l. The limit function Uoo^ri') coincides on [0,1] with 
the exit time expectation Fr{-) defined in (5.1). 

Proof. The characterization in (3.13) indicates that the derivative of 
Uoo,r is bounded on (/,r), for < / < r. Then, for vr € (Z,r), a localization 
argument and Ito's rule gives 

E-noo,r.(n^[,,j) 

(A.4) ='Uoo,r(vr) +E'^ / [(-A + A)^ioo,r(n„_) + Anoo,r(S(n„_))]d'u 

JO 

— 'U'00,r('^)) 

where r[; ,,] is the exit time of 11 from the interval {l,r). The boundary {0} 
is natural for the diffusive part of the process IT and its jumps are positive 
(toward {1}). This implies that rj^^^j /^Tr = inf{t > OiIIj > r} as I ^ 0+, 
P'^-almost surely [see also (2.12)]. Therefore, when we let l^Q'^ in (A.4) 
we obtain 

■Uoo,r(vr)= lim E''Uoo,r(n?^,, 

Z->-0+ ^ ' ' 

= ^hm noo,r(0ff^"{T[7,r] < %} + l{r^,^^^=rr}K^r^ 

= E-M%)- 

This shows Woo,r(') =-^r(') on (0,r). 

When Ho = 0, the process stays at {0} until the first arrival time Ti 
of N . It jumps to {p} at Ti. Hence, by strong Markov property, we have 

Fr(0) = Fr{p), and this shows Uoo,r(0) = i^r(O) [since t(oo,r(0) = ?^oo,r(p)]- 

Finally, for tt > r, we have noo,r('?i") = 1 — tt by the construction in (A.l); 
hence, the equality Uoo,r{-) = Fr{-) is obvious. □ 
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APPENDIX B: OTHER PROOFS 



Proof of (2.10). The process is a (P, F)-Brownian motion (this can 
be verified using Levy's characterization for Brownian motion) and iV is a 
(P,F)-Poisson process. Therefore, it is sufficient to show (2.10) for si = S2 = 
s. 

Note that the process W can be written as 



(B.l) 



Wt = Wt + ^i ! [l{e<u} - n«] du. 
Jo 



Therefore, if we apply Ito formula to real and imaginary parts of the process 
-f^t := f(Wt, Nf), for f{x, y) = expjirx + iqy}-, we obtain 



f'S PS PS 

/ rKudWu + / r^iKul{e<u}du- / r^xKJlu 
Jt Jt Jt 



du 



:r- I Kudu+ {e"i - l)Ku{dNu - Xdu) 



(B.2) 



for t <u< s. Clearly, we have 



+ / A(e*'? - l)i^„ 



E 



{e''^ -l)Ku{dNu- Xdu) 



= E 



K^dWu 



Moreover, for a set Ti we have El^il'„l{0<„j = ^X^K^u- Then by 

multiplying both sides in (B.2) with XaIJ^i = 1a • e~*''^'~*'^^' and taking 
the expectations we get 

E[Uexp{ir(P^, - Wt) + ig(iV. - iVt)}] 
= P(^) + jJ"'(-y + A(e*'?-i; 

X E[Uexp{ir(M?, - Wt) + iq{Nu - Nt)}\ du. 

By solving this integral equation for the (deterministic) function 

Qt{^ : s ^ E[U exp{ir(t?, - Wt) + iq[N, - Nt)}\ 

we obtain Qt{s) = P(yl) •exp{(-^ + A(e'« - l))(s -t)}, and this proves (2.10) 
for s\ = S2 = s. □ 
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Proof of (3.20). Let vr be a fixed point on (0,r[u)]). For any r > r[w], 
Hr[w]{-K) is given by (3.13) witli 

dHr[w]{TT) _ iP{tt) 



dr Tp^{r) 

^ _j0(7r)_ 
?/^^(r) 



h{r)ip' (r) + tl;{r) - {mi - 1712) / U2[w]{y)dy 
B[w]{r). 



The last expression is strictly positive for r > r[t(;] since B['w]{r) is strictly 
negative thanks to Lemma 3.3. This implies that Hj.[u,][w]{'it) < Hr^{'K) < 
Hr2i'n'), for all r[w] < ri < r2, and we have Hr[w]{TT) < limr/'iHr[w]{Tr). 
Since the right boundary is natural, 00 as r 1. Then by dominated 
convergence theorem (see Remark 3.2), we obtain 



00 

Xt 



e-^\g{Yt) + Xwi§iYt)))dt 



< / {g (tt) + Xw {E{Tr))) dt 
Jo 

^ gjir) + Xw{8{7t)) 
X 

where the second inequality is by Jensen's inequality [recall that y is a 
martingale and w{-) is concave], and (3.20) follows. □ 

Proof of Remark 5.1. The limits in (5.7) follow easily from (3.19). It 
is also clear that c i-t- vr 00(c) is nonincreasing thanks to (1.2) and Remark 3.3. 
Here, we show that ci-T>7roo(c) is continuous on (0, 00). 

Let Vc{7r) and Bc[-] denote respectively the dependence on c of the value 
function V and the operator B[-] defined in (3.18). 

Since the value function V is a fixed point of the operator J, Lemma 3.3 
gives 

BcAyci]{T^oo{ci))=0 = Bc,[Vc,]{7Too{c2)) for < Cl < C2 < OO. 

By using these equalities together with the explicit form of B.[-] in (3.18) 
[and the identity Aoip{-) = Xip{-)], we obtain 

< J (^oo (C2 ) ) - 5ci [14 J (^oo (Cl ) ) 

(B.3) ^ y^[c,y + XV,Am)-my)]dy 

^[(C2 - Cl)?/ + X{V,,{8{y)) - V,, (S(y)))] dy. 
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Moreover, we have Vc^iT^) < IP^'It^ooCci) < ©) + ^2'^'" (.t^^(ci) - Q)"^; and this 
gives the Lipschitz condition 

for any 6 <ci. Using this inequahty in (B.3), we obtain 



< 



A 



-[c^y + \V,,{^{y)) - Xh{y)]dy 



(B.4) 



< 



71"oo(c2) „/// 



A 



(C2 - Ci) 



y + 



A 



dy 



< (C2 - Ci) 



1 1 

A + ^ 



'0'(7roo(c2))- 



This imphes that 7roo(c2) /^vroo(ci) as C2 \ci. 
Similarly, it is easy to show that 



< 



7roo(c2) 



A 



-[c2y + XV,,i8iy))->^hiy)]dy 



71"oo(ci) ,/,// 



riy) 







A 



[(C2 - ci)y + x{v,My)) - VcAHy)))] dy 



< 



7roo(ci) ;// 



X 



(C2 - Ci) 



1 + 



(C2 - Ci] 



1 1 

A + I 



^'(vroo(ci)) 



for some 6 < Ci. This shows that 7roo(ci) \ vroo(c2) as ci C2, and the 
continuity of ci— 7'7roo(c) follows. □ 
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